Eyewear having current consumption optimization of wireless system interface

ABSTRACT

Eyewear having a high-speed wireless transceiver, including a processor having a high-speed interface for communicating high-speed communications and a low-speed interface for communicating low-speed communications. The high-speed interface is disabled to have no standby current and only the low-speed interface is used when only low-speed communications are needed to save current. When communications are received via the high-speed wireless transceiver, only the low-speed interface is initially used, and the high-power interface is later used if necessary. The high-speed interface can be a high-speed universal serial bus (USB) interface, and the low-speed interface can be a universal asynchronous receiver-transmitter (UART) interface. A USB hub is controlled by the processor to selectively enable the USB interface.

TECHNICAL FIELD

The present subject matter relates to the field of eyewear.

BACKGROUND

Eyewear, including smart glasses, are configured to wirelessly connectwith networks and other eyewear using a wireless system interface.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawing figures depict one or more implementations, by way ofexample only, not by way of limitations. In the figures, like referencenumerals refer to the same or similar elements.

FIG. 1A is a side view of an example hardware configuration of aneyewear device, which shows a right optical assembly with an imagedisplay, and field of view adjustments are applied to a user interfacepresented on the image display based on detected head or eye movement bya user;

FIG. 1B is a top cross-sectional view of a temple of the eyewear deviceof FIG. 1A depicting a visible light camera, a head movement tracker fortracking the head movement of the user of the eyewear device, and acircuit board;

FIG. 2A is a rear view of an example hardware configuration of aneyewear device, which includes an eye scanner on a frame, for use in asystem for identifying a user of the eyewear device;

FIG. 2B is a rear view of an example hardware configuration of anothereyewear device, which includes an eye scanner on a temple, for use in asystem for identifying a user of the eyewear device;

FIGS. 2C and 2D are rear views of example hardware configurations of theeyewear device, including two different types of image displays:

FIG. 3 shows a rear perspective view of the eyewear device of FIG. 2Adepicting an infrared emitter, an infrared camera, a frame front, aframe back, and a circuit board;

FIG. 4 is a cross-sectional view taken through the infrared emitter andthe frame of the eyewear device of FIG. 3 ;

FIG. 5 illustrates detecting eye gaze direction;

FIG. 6 illustrates detecting eye position;

FIG. 7 depicts an example of visible light captured by the left visiblelight camera as a left raw image and visible light captured by the rightvisible light camera as a right raw image;

FIG. 8 illustrates a block diagram of electronic components of theeyewear device including the high-speed wireless transceiver;

FIG. 9 illustrates a portion of the eyewear control circuitry includinga high-speed interface and a low-speed interface; and

FIG. 10 illustrates a method of operating the eyewear.

DETAILED DESCRIPTION

This disclosure is directed to eyewear having a high-speed wirelesstransceiver, including a processor having a high-speed interface forcommunicating high-speed communications and a low-speed interface forcommunicating low-speed communications. The high-speed interface isdisabled to have no standby current and only the low-speed interface isused when only low-speed communications are needed to save current. Whencommunications are received via the high-speed wireless transceiver,only the low-speed interface is initially used, and the high-powerinterface is later used if necessary. The high-speed interface can be ahigh-speed universal serial bus (USB) interface, and the low-speedinterface can be a universal asynchronous receiver-transmitter (UART)interface. A USB hub is controlled by the processor to selectivelyenable the USB interface.

Additional objects, advantages and novel features of the examples willbe set forth in part in the description which follows, and in part willbecome apparent to those skilled in the art upon examination of thefollowing and the accompanying drawings or may be learned by productionor operation of the examples. The objects and advantages of the presentsubject matter may be realized and attained by means of themethodologies, instrumentalities and combinations particularly pointedout in the appended claims.

In the following detailed description, numerous specific details are setforth by way of examples in order to provide a thorough understanding ofthe relevant teachings. However, it should be apparent to those skilledin the art that the present teachings may be practiced without suchdetails. In other instances, well known methods, procedures, components,and circuitry have been described at a relatively high-level, withoutdetail, in order to avoid unnecessarily obscuring aspects of the presentteachings.

The term “coupled” as used herein refers to any logical, optical,physical or electrical connection, link or the like by which signals orlight produced or supplied by one system element are imparted to anothercoupled element. Unless described otherwise, coupled elements or devicesare not necessarily directly connected to one another and may beseparated by intermediate components, elements or communication mediathat may modify, manipulate or carry the light or signals.

The orientations of the eyewear device, associated components and anycomplete devices incorporating an eye scanner and camera such as shownin any of the drawings, are given by way of example only, forillustration and discussion purposes. In operation for a particularvariable optical processing application, the eyewear device may beoriented in any other direction suitable to the particular applicationof the eyewear device, for example up, down, sideways, or any otherorientation. Also, to the extent used herein, any directional term, suchas front, rear, inwards, outwards, towards, left, right, lateral,longitudinal, up, down, upper, lower, top, bottom and side, are used byway of example only, and are not limiting as to direction or orientationof any optic or component of an optic constructed as otherwise describedherein.

Reference now is made in detail to the examples illustrated in theaccompanying drawings and discussed below.

FIG. 1A is a side view of an example hardware configuration of aneyewear device 100, which includes a right optical assembly 180B with animage display 180D (FIG. 2A). Eyewear device 100 includes multiplevisible light cameras 114A-B (FIG. 7 ) that form a stereo camera, ofwhich the right visible light camera 114B is located on a right temple110B.

The left and right visible light cameras 114A-B have an image sensorthat is sensitive to the visible light range wavelength. Each of thevisible light cameras 114A-B have a different frontward facing angle ofcoverage, for example, visible light camera 114B has the depicted angleof coverage 111B. The angle of coverage is an angle range which theimage sensor of the visible light camera 114A-B picks up electromagneticradiation and generates images. Examples of such visible lights camera114A-B include a high-resolution complementary metal-oxide-semiconductor(CMOS) image sensor and a video graphic array (VGA) camera, such as 640p(e.g., 640×480 pixels for a total of 0.3 megapixels), 720p, or 1080p.Image sensor data from the visible light cameras 114A-B are capturedalong with geolocation data, digitized by an image processor, and storedin a memory.

To provide stereoscopic vision, visible light cameras 114A-B may becoupled to an image processor (element 812 of FIG. 8 ) for digitalprocessing along with a timestamp in which the image of the scene iscaptured. Image processor 812 includes circuitry to receive signals fromthe visible light camera 114A-B and process those signals from thevisible light cameras 114A-B into a format suitable for storage in thememory (element 834 of FIG. 8 ). The timestamp can be added by the imageprocessor 812 or other processor, which controls operation of thevisible light cameras 114A-B. Visible light cameras 114A-B allow thestereo camera to simulate human binocular vision. Stereo cameras providethe ability to reproduce three-dimensional images (element 715 of FIG. 7) based on two captured images (elements 758A-B of FIG. 7 ) from thevisible light cameras 114A-B, respectively, having the same timestamp.Such three-dimensional images 715 allow for an immersive life-likeexperience, e.g., for virtual reality or video gaming. For stereoscopicvision, the pair of images 758A-B are generated at a given moment intime — one image for each of the left and right visible light cameras114A-B. When the pair of generated images 758A-B from the frontwardfacing field of view (FOV) 111A-B of the left and right visible lightcameras 114A-B are stitched together (e.g., by the image processor 812),depth perception is provided by the optical assembly 180A-B.

In an example, a user interface field of view adjustment system includesthe eyewear device 100. The eyewear device 100 includes a frame 105, aright temple 110B extending from a right lateral side 170B of the frame105, and a see-through image display 180D (FIGS. 2A-B) comprisingoptical assembly 180B to present a graphical user interface to a user.The eyewear device 100 includes the left visible light camera 114Aconnected to the frame 105 or the left temple 110A to capture a firstimage of the scene. Eyewear device 100 further includes the rightvisible light camera 114B connected to the frame 105 or the right temple110B to capture (e.g., simultaneously with the left visible light camera114A) a second image of the scene which partially overlaps the firstimage. Although not shown in FIGS. 1A-B, the user interface field ofview adjustment system further includes the processor 832 coupled to theeyewear device 100 and connected to the visible light cameras 114A-B,the memory 834 accessible to the processor 832, and programming in thememory 834, for example in the eyewear device 100 itself or another partof the user interface field of view adjustment system.

Although not shown in FIG. 1A, the eyewear device 100 also includes ahead movement tracker (element 109 of FIG. 1B) or an eye movementtracker (element 213 of FIG. 2B). Eyewear device 100 further includesthe see-through image displays 180C-D of optical assembly 180A-B,respectfully, for presenting a sequence of displayed images, and animage display driver (element 842 of FIG. 8 ) coupled to the see-throughimage displays 180C-D of optical assembly 180A-B to control the imagedisplays 180C-D of optical assembly 180A-B to present the sequence ofdisplayed images 715, which are described in further detail below.Eyewear device 100 further includes the memory 834 and the processor 832having access to the image display driver 842 and the memory 834.Eyewear device 100 further includes programming (element 834 of FIG. 8 )in the memory. Execution of the programming by the processor 832configures the eyewear device 100 to perform functions, includingfunctions to present, via the see-through image displays 180C-D, aninitial displayed image of the sequence of displayed images, the initialdisplayed image having an initial field of view corresponding to aninitial head direction or an initial eye gaze direction (element 230 ofFIG.5).

Execution of the programming by the processor 832 further configures theeyewear device 100 to detect movement of a user of the eyewear deviceby: (i) tracking, via the head movement tracker (element 109 of FIG.1B), a head movement of a head of the user, or (ii) tracking, via an eyemovement tracker (element 213 of FIG. 2B, FIG. 5 ), an eye movement ofan eye of the user of the eyewear device 100. Execution of theprogramming by the processor 832 further configures the eyewear device100 to determine a field of view adjustment to the initial field of viewof the initial displayed image based on the detected movement of theuser. The field of view adjustment includes a successive field of viewcorresponding to a successive head direction or a successive eyedirection. Execution of the programming by the processor 832 furtherconfigures the eyewear device 100 to generate a successive displayedimage of the sequence of displayed images based on the field of viewadjustment. Execution of the programming by the processor 832 furtherconfigures the eyewear device 100 to present, via the see-through imagedisplays 180C-D of the optical assembly 180A-B, the successive displayedimages.

FIG. 1B is a top cross-sectional view of the temple of the eyeweardevice 100 of FIG. 1A depicting the right visible light camera 114B, ahead movement tracker 109, and a circuit board. Construction andplacement of the left visible light camera 114A is substantially similarto the right visible light camera 114B, except the connections andcoupling are on the left lateral side 170A. As shown, the eyewear device100 includes the right visible light camera 114B and a circuit board,which may be a flexible printed circuit board (PCB) 140. The right hinge126B connects the right temple 110B to a right temple 125B of theeyewear device 100. In some examples, components of the right visiblelight camera 114B, the flexible PCB 140, or other electrical connectorsor contacts may be located on the right temple 125B or the right hinge126B.

As shown, eyewear device 100 has a head movement tracker 109, whichincludes, for example, an inertial measurement unit (IMU). An inertialmeasurement unit is an electronic device that measures and reports abody's specific force, angular rate, and sometimes the magnetic fieldsurrounding the body, using a combination of accelerometers andgyroscopes, sometimes also magnetometers. The inertial measurement unitworks by detecting linear acceleration using one or more accelerometersand rotational rate using one or more gyroscopes. Typical configurationsof inertial measurement units contain one accelerometer, gyro, andmagnetometer per axis for each of the three axes: horizontal axis forleft-right movement (X), vertical axis (Y) for top-bottom movement, anddepth or distance axis for up-down movement (Z). The accelerometerdetects the gravity vector. The magnetometer defines the rotation in themagnetic field (e.g., facing south, north, etc.) like a compass whichgenerates a heading reference. The three accelerometers to detectacceleration along the horizontal, vertical, and depth axis definedabove, which can be defined relative to the ground, the eyewear device100, or the user wearing the eyewear device 100.

Eyewear device 100 detects movement of the user of the eyewear device100 by tracking, via the head movement tracker 109, the head movement ofthe head of the user. The head movement includes a variation of headdirection on a horizontal axis, a vertical axis, or a combinationthereof from the initial head direction during presentation of theinitial displayed image on the image display. In one example, tracking,via the head movement tracker 109, the head movement of the head of theuser includes measuring, via the inertial measurement unit 109, theinitial head direction on the horizontal axis (e.g., X axis), thevertical axis (e.g., Y axis), or the combination thereof (e.g.,transverse or diagonal movement). Tracking, via the head movementtracker 109, the head movement of the head of the user further includesmeasuring, via the inertial measurement unit 109, a successive headdirection on the horizontal axis, the vertical axis, or the combinationthereof during presentation of the initial displayed image.

Tracking, via the head movement tracker 109, the head movement of thehead of the user further includes determining the variation of headdirection based on both the initial head direction and the successivehead direction. Detecting movement of the user of the eyewear device 100further includes in response to tracking, via the head movement tracker109, the head movement of the head of the user, determining that thevariation of head direction exceeds a deviation angle threshold on thehorizontal axis, the vertical axis, or the combination thereof. Thedeviation angle threshold is between about 3° to 10°. As used herein,the term “about” when referring to an angle means±10% from the statedamount.

Variation along the horizontal axis slides three-dimensional objects,such as characters, Bitmojis, application icons, etc. in and out of thefield of view by, for example, hiding, unhiding, or otherwise adjustingvisibility of the three-dimensional object. Variation along the verticalaxis, for example, when the user looks upwards, in one example, displaysweather information, time of day, date, calendar appointments, etc. Inanother example, when the user looks downwards on the vertical axis, theeyewear device 100 may power down.

The right temple 110B includes temple body 211 and a temple cap, withthe temple cap omitted in the cross-section of FIG. 1B. Disposed insidethe right temple 110B are various interconnected circuit boards, such asPCBs or flexible PCBs, that include controller circuits for rightvisible light camera 114B, microphone(s) 130, speaker(s) 132, low-powerwireless circuitry (e.g., for wireless short-range network communicationvia Bluetooth™), high-speed wireless circuitry (e.g., for wireless localarea network communication via WiFi).

The right visible light camera 114B is coupled to or disposed on theflexible PCB 240 and covered by a visible light camera cover lens, whichis aimed through opening(s) formed in the right temple 110B. In someexamples, the frame 105 connected to the right temple 110B includes theopening(s) for the visible light camera cover lens. The frame 105includes a front-facing side configured to face outwards away from theeye of the user. The opening for the visible light camera cover lens isformed on and through the front-facing side. In the example, the rightvisible light camera 114B has an outward facing angle of coverage 111Bwith a line of sight or perspective of the right eye of the user of theeyewear device 100. The visible light camera cover lens can also beadhered to an outward facing surface of the right temple 110B in whichan opening is formed with an outward facing angle of coverage, but in adifferent outwards direction. The coupling can also be indirect viaintervening components.

Left (first) visible light camera 114A is connected to the leftsee-through image display 180C of left optical assembly 180A to generatea first background scene of a first successive displayed image. Theright (second) visible light camera 114B is connected to the rightsee-through image display 180D of right optical assembly 180B togenerate a second background scene of a second successive displayedimage. The first background scene and the second background scenepartially overlap to present a three-dimensional observable area of thesuccessive displayed image.

Flexible PCB 140 is disposed inside the right temple 110B and is coupledto one or more other components housed in the right temple 110B.Although shown as being formed on the circuit boards of the right temple110B, the right visible light camera 114B can be formed on the circuitboards of the left temple 110A, the temples 125A-B, or frame 105.

FIG. 2A is a rear view of an example hardware configuration of aneyewear device 100, which includes an eye scanner 113 on a frame 105,for use in a system for determining an eye position and gaze directionof a wearer/user of the eyewear device 100. As shown in FIG. 2A, theeyewear device 100 is in a form configured for wearing by a user, whichare eyeglasses in the example of FIG. 2A. The eyewear device 100 cantake other forms and may incorporate other types of frameworks, forexample, a headgear, a headset, or a helmet.

In the eyeglasses example, eyewear device 100 includes the frame 105which includes the left rim 107A connected to the right rim 107B via thebridge 106 adapted for a nose of the user. The left and right rims107A-B include respective apertures 175A-B which hold the respectiveoptical element 180A-B, such as a lens and the see-through displays180C-D. As used herein, the term lens is meant to cover transparent ortranslucent pieces of glass or plastic having curved and flat surfacesthat cause light to converge/diverge or that cause little or noconvergence/divergence.

Although shown as having two optical elements 180A-B, the eyewear device100 can include other arrangements, such as a single optical elementdepending on the application or intended user of the eyewear device 100.As further shown, eyewear device 100 includes the left temple 110Aadjacent the left lateral side 170A of the frame 105 and the righttemple 110B adjacent the right lateral side 170B of the frame 105. Thetemples 110A-B may be integrated into the frame 105 on the respectivesides 170A-B (as illustrated) or implemented as separate componentsattached to the frame 105 on the respective sides 170A-B. Alternatively,the temples 110A-B may be integrated into temples (not shown) attachedto the frame 105.

In the example of FIG. 2A, the eye scanner 113 includes an infraredemitter 115 and an infrared camera 120. Visible light cameras typicallyinclude a blue light filter to block infrared light detection, in anexample, the infrared camera 120 is a visible light camera, such as alow-resolution video graphic array (VGA) camera (e.g., 640×480 pixelsfor a total of 0.3 megapixels), with the blue filter removed. Theinfrared emitter 115 and the infrared camera 120 are co-located on theframe 105, for example, both are shown as connected to the upper portionof the left rim 107A. The frame 105 or one or more of the left and righttemples 110A-B include a circuit board (not shown) that includes theinfrared emitter 115 and the infrared camera 120. The infrared emitter115 and the infrared camera 120 can be connected to the circuit board bysoldering, for example.

Other arrangements of the infrared emitter 115 and infrared camera 120can be implemented, including arrangements in which the infrared emitter115 and infrared camera 120 are both on the right rim 107B, or indifferent locations on the frame 105, for example, the infrared emitter115 is on the left rim 107A and the infrared camera 120 is on the rightrim 107B. In another example, the infrared emitter 115 is on the frame105 and the infrared camera 120 is on one of the temples 110A-B, or viceversa. The infrared emitter 115 can be connected essentially anywhere onthe frame 105, left temple 110A, or right temple 110B to emit a patternof infrared light. Similarly, the infrared camera 120 can be connectedessentially anywhere on the frame 105, left temple 110A, or right temple110B to capture at least one reflection variation in the emitted patternof infrared light.

The infrared emitter 115 and infrared camera 120 are arranged to faceinwards towards an eye of the user with a partial or full field of viewof the eye in order to identify the respective eye position and gazedirection. For example, the infrared emitter 115 and infrared camera 120are positioned directly in front of the eye, in the upper part of theframe 105 or in the temples 110A-B at either ends of the frame 105.

FIG. 2B is a rear view of an example hardware configuration of anothereyewear device 200. In this example configuration, the eyewear device200 is depicted as including an eye scanner 213 on a right temple 210B.As shown, an infrared emitter 215 and an infrared camera 220 areco-located on the right temple 210B. It should be understood that theeye scanner 213 or one or more components of the eye scanner 213 can belocated on the left temple 210A and other locations of the eyeweardevice 200, for example, the frame 105. The infrared emitter 215 andinfrared camera 220 are like that of FIG. 2A, but the eye scanner 213can be varied to be sensitive to different light wavelengths asdescribed previously in FIG. 2A.

Similar to FIG. 2A, the eyewear device 200 includes a frame 105 whichincludes a left rim 107A which is connected to a right rim 107B via abridge 106; and the left and right rims 107A-B include respectiveapertures which hold the respective optical elements 180A-B comprisingthe see-through display 180C-D.

FIGS. 2C-D are rear views of example hardware configurations of theeyewear device 100, including two different types of see-through imagedisplays 180C-D. In one example, these see-through image displays 180C-Dof optical assembly 180A-B include an integrated image display. As shownin FIG. 2C, the optical assemblies 180A-B includes a suitable displaymatrix 180C-D of any suitable type, such as a liquid crystal display(LCD), an organic light-emitting diode (OLED) display, a waveguidedisplay, or any other such display.

The optical assembly 180A-B also includes an optical layer or layers176, which can include lenses, optical coatings, prisms, mirrors,waveguides, optical strips, and other optical components in anycombination. The optical layers 176A-N can include a prism having asuitable size and configuration and including a first surface forreceiving light from display matrix and a second surface for emittinglight to the eye of the user. The prism of the optical layers 176A-Nextends over all or at least a portion of the respective apertures175A-B formed in the left and right rims 107A-B to permit the user tosee the second surface of the prism when the eye of the user is viewingthrough the corresponding left and right rims 107A-B. The first surfaceof the prism of the optical layers 176A-N faces upwardly from the frame105 and the display matrix overlies the prism so that photons and lightemitted by the display matrix impinge the first surface. The prism issized and shaped so that the light is refracted within the prism and isdirected towards the eye of the user by the second surface of the prismof the optical layers 176A-N. In this regard, the second surface of theprism of the optical layers 176A-N can be convex to direct the lighttowards the center of the eye. The prism can optionally be sized andshaped to magnify the image projected by the see-through image displays180C-D, and the light travels through the prism so that the image viewedfrom the second surface is larger in one or more dimensions than theimage emitted from the see-through image displays 180C-D.

In another example, the see-through image displays 180C-D of opticalassembly 180A-B include a projection image display as shown in FIG. 2D.The optical assembly 180A-B includes a projector 150, which may be athree-color projector using a scanning mirror, a galvanometer, a laserprojector, or other types of projectors. During operation, an opticalsource such as a projector 150 is disposed in or on one of the temples125A-B of the eyewear device 100. Optical assembly 180A-B includes oneor more optical strips 155A-N spaced apart across the width of the lensof the optical assembly 180A-B or across a depth of the lens between thefront surface and the rear surface of the lens. A detailed example of aprojector is shown in FIGS. 8A-8J.

As the photons projected by the projector 150 travel across the lens ofthe optical assembly 180A-B, the photons encounter the optical strips155A-N. When a particular photon encounters a particular optical strip,the photon is either redirected towards the user's eye, or it passes tothe next optical strip. A combination of modulation of projector 150,and modulation of optical strips, may control specific photons or beamsof light. In an example, a processor 832 (FIG. 9 ) controls opticalstrips 155A-N by initiating mechanical, acoustic, or electromagneticsignals. Although shown as having two optical assemblies 180A-B, theeyewear device 100 can include other arrangements, such as a single orthree optical assemblies, or the optical assembly 180A-B may havearranged different arrangement depending on the application or intendeduser of the eyewear device 100.

As further shown in FIGS. 2C-D, eyewear device 100 includes a lefttemple 110A adjacent the left lateral side 170A of the frame 105 and aright temple 110B adjacent the right lateral side 170B of the frame 105.The temples 110A-B may be integrated into the frame 105 on therespective lateral sides 170A-B (as illustrated) or implemented asseparate components attached to the frame 105 on the respective sides170A-B. Alternatively, the temples 110A-B may be integrated into temples125A-B attached to the frame 105.

In one example, the see-through image displays include the firstsee-through image display 180C and the second see-through image display180D. Eyewear device 100 includes first and second apertures 175A-Bwhich hold the respective first and second optical assembly 180A-B. Thefirst optical assembly 180A includes the first see-through image display180C (e.g., a display matrix of FIG. 2C or optical strips 155A-N′ and aprojector 150A). The second optical assembly 180B includes the secondsee-through image display 180D e.g., a display matrix of FIG. 2C oroptical strips 155A-N″ and a projector 150B). The successive field ofview of the successive displayed image includes an angle of view betweenabout 15° to 30, and more specifically 24°, measured horizontally,vertically, or diagonally. The successive displayed image having thesuccessive field of view represents a combined three-dimensionalobservable area visible through stitching together of two displayedimages presented on the first and second image displays.

As used herein, “an angle of view” describes the angular extent of thefield of view associated with the displayed images presented on each ofthe left and right image displays 180C-D of optical assembly 180A-B. The“angle of coverage” describes the angle range that a lens of visiblelight cameras 114A-B or infrared camera 220 can image. Typically, theimage circle produced by a lens is large enough to cover the film orsensor completely, possibly including some vignetting (i.e., a reductionof an image's brightness or saturation toward the periphery compared tothe image center). If the angle of coverage of the lens does not fillthe sensor, the image circle will be visible, typically with strongvignetting toward the edge, and the effective angle of view will belimited to the angle of coverage. The “field of view” is intended todescribe the field of observable area which the user of the eyeweardevice 100 can see through his or her eyes via the displayed imagespresented on the left and right image displays 180C-D of the opticalassembly 180A-B. Image display 180C of optical assembly 180A-B can havea field of view with an angle of coverage between 15° to 30°, forexample 24°, and have a resolution of 480×480 pixels.

FIG. 3 shows a rear perspective view of the eyewear device of FIG. 2A.The eyewear device 100 includes an infrared emitter 215, infrared camera220, a frame front 330, a frame back 335, and a circuit board 340. Itcan be seen in FIG. 3 that the upper portion of the left rim of theframe of the eyewear device 100 includes the frame front 330 and theframe back 335. An opening for the infrared emitter 215 is formed on theframe back 335.

As shown in the encircled cross-section 4 in the upper middle portion ofthe left rim of the frame, a circuit board, which is a flexible PCB 340,is sandwiched between the frame front 330 and the frame back 335. Alsoshown in further detail is the attachment of the left temple 110A to theleft temple 325A via the left hinge 126A. In some examples, componentsof the eye movement tracker 213, including the infrared emitter 215, theflexible PCB 340, or other electrical connectors or contacts may belocated on the left temple 325A or the left hinge 126A.

FIG. 4 is a cross-sectional view through the infrared emitter 215 andthe frame corresponding to the encircled cross-section 4 of the eyeweardevice of FIG. 3 . Multiple layers of the eyewear device 100 areillustrated in the cross-section of FIG. 4 , as shown the frame includesthe frame front 330 and the frame back 335. The flexible PCB 340 isdisposed on the frame front 330 and connected to the frame back 335. Theinfrared emitter 215 is disposed on the flexible PCB 340 and covered byan infrared emitter cover lens 445. For example, the infrared emitter215 is reflowed to the back of the flexible PCB 340. Reflowing attachesthe infrared emitter 215 to contact pad(s) formed on the back of theflexible PCB 340 by subjecting the flexible PCB 340 to controlled heatwhich melts a solder paste to connect the two components. In oneexample, reflowing is used to surface mount the infrared emitter 215 onthe flexible PCB 340 and electrically connect the two components.However, it should be understood that through-holes can be used toconnect leads from the infrared emitter 215 to the flexible PCB 340 viainterconnects, for example.

The frame back 335 includes an infrared emitter opening 450 for theinfrared emitter cover lens 445. The infrared emitter opening 450 isformed on a rear-facing side of the frame back 335 that is configured toface inwards towards the eye of the user. In the example, the flexiblePCB 340 can be connected to the frame front 330 via the flexible PCBadhesive 460. The infrared emitter cover lens 445 can be connected tothe frame back 335 via infrared emitter cover lens adhesive 455. Thecoupling can also be indirect via intervening components.

In an example, the processor 832 utilizes eye tracker 213 to determinean eye gaze direction 230 of a wearer's eye 234 as shown in FIG. 5 , andan eye position 236 of the wearer's eye 234 within an eyebox as shown inFIG. 6 . The eye tracker 213 is a scanner which uses infrared lightillumination (e.g., near-infrared, short-wavelength infrared,mid-wavelength infrared, long-wavelength infrared, or far infrared) tocaptured image of reflection variations of infrared light from the eye234 to determine the gaze direction 230 of a pupil 232 of the eye 234,and also the eye position 236 with respect to the see-through display180D.

FIG. 7 depicts an example of capturing visible light with cameras114A-B. Visible light is captured by the left visible light camera 114Awith a round field of view (FOV). 111A. A chosen rectangular left rawimage 758A is used for image processing by image processor 812 (FIG. 8). Visible light is captured by the right visible light camera 114B witha round FOV 111B. A rectangular right raw image 758B chosen by the imageprocessor 812 is used for image processing by processor 812. Based onprocessing of the left raw image 758A and the right raw image 758B, athree-dimensional image 715 of a three-dimensional scene, referred tohereafter as an immersive image, is generated by processor 812 anddisplayed by displays 180C and 180D and which is viewable by the user.

FIG. 8 depicts a high-level functional block diagram including exampleelectronic components disposed in eyewear 100 and 200. The illustratedelectronic components include the processor 832, the memory 834, and thesee-through image display 180C and 180D.

Memory 834 includes instructions for execution by processor 832 toimplement functionality of eyewear 100/200, including instructions forprocessor 832 to control in the image 715. Processor 832 receives powerfrom battery 850 and executes the instructions stored in memory 834, orintegrated with the processor 832 on-chip, to perform functionality ofeyewear 100/200, and communicating with external devices via wirelessconnections.

A user interface adjustment system 800 includes a wearable device, whichis the eyewear device 100 with an eye movement tracker 213 (e.g., shownas infrared emitter 215 and infrared camera 220 in FIG. 2B). Userinterface adjustments system 800 also includes a mobile device 890 and aserver system 898 connected via various networks. Mobile device 890 maybe a smartphone, tablet, laptop computer, access point, or any othersuch device capable of connecting with eyewear device 100 using both alow-power wireless connection 825 and a high-speed wireless connection837. Mobile device 890 is connected to server system 898 and network895. The network 895 may include any combination of wired and wirelessconnections.

Eyewear device 100 includes at least two visible light cameras 114A-B(one associated with the left lateral side 170A and one associated withthe right lateral side 170B). Eyewear device 100 further includes twosee-through image displays 180C-D of the optical assembly 180A-B (oneassociated with the left lateral side 170A and one associated with theright lateral side 170B). Eyewear device 100 also includes image displaydriver 842, image processor 812, low-power circuitry 820, and high-speedcircuitry 830. The components shown in FIG. 8 for the eyewear device 100and 200 are located on one or more circuit boards, for example a PCB orflexible PCB, in the temples. Alternatively, or additionally, thedepicted components can be located in the temples, frames, hinges, orbridge of the eyewear device 100 and 200. Left and right visible lightcameras 114A-B can include digital camera elements such as acomplementary metal-oxide-semiconductor (CMOS) image sensor, chargecoupled device, a lens, or any other respective visible or lightcapturing elements that may be used to capture data, including images ofscenes with unknown objects.

Eye movement tracking programming 845 implements the user interfacefield of view adjustment instructions, including, to cause the eyeweardevice 100 to track, via the eye movement tracker 213, the eye movementof the eye of the user of the eyewear device 100. Other implementedinstructions (functions) cause the eyewear device 100 and 200 todetermine the FOV adjustment to the initial FOV 111A-B based on thedetected eye movement of the user corresponding to a successive eyedirection. Further implemented instructions generate a successivedisplayed image of the sequence of displayed images based on the fieldof view adjustment. The successive displayed image is produced asvisible output to the user via the user interface. This visible outputappears on the see-through image displays 180C-D of optical assembly180A-B, which is driven by image display driver 834 to present thesequence of displayed images, including the initial displayed image withthe initial field of view and the successive displayed image with thesuccessive field of view.

As shown in FIG. 8 , high-speed circuitry 830 includes high-speedprocessor 832, memory 834, and high-speed wireless circuitry 836. In theexample, the image display driver 842 is coupled to the high-speedcircuitry 830 and operated by the high-speed processor 832 in order todrive the left and right image displays 180C-D of the optical assembly180A-B. High-speed processor 832 may be any processor capable ofmanaging high-speed communications and operation of any generalcomputing system needed for eyewear device 100. High-speed processor 832includes processing resources needed for managing high-speed datatransfers on high-speed wireless connection 837 to a wireless local areanetwork (WLAN) using high-speed wireless circuitry 836. In certainexamples, the high-speed processor 832 executes an operating system suchas a LINUX operating system or other such operating system of theeyewear device 100 and the operating system is stored in memory 834 forexecution. In addition to any other responsibilities, the high-speedprocessor 832 executing a software architecture for the eyewear device100 is used to manage data transfers with high-speed wireless circuitry836. In certain examples, high-speed wireless circuitry 836 isconfigured to implement Institute of Electrical and Electronic Engineers(IEEE) 802.11 communication standards, also referred to herein as Wi-Fi.In other examples, other high-speed communications standards may beimplemented by high-speed wireless circuitry 836.

Low-power wireless circuitry 824 and the high-speed wireless circuitry836 of the eyewear device 100 and 200 can include short rangetransceivers (Bluetooth™) and wireless wide, local, or wide area networktransceivers (e.g., cellular or WiFi). Mobile device 890, including thetransceivers communicating via the low-power wireless connection 825 andhigh-speed wireless connection 837, may be implemented using details ofthe architecture of the eyewear device 100, as can other elements ofnetwork 895.

Memory 834 includes any storage device capable of storing various dataand applications, including, among other things, color maps, camera datagenerated by the left and right visible light cameras 114A-B and theimage processor 812, as well as images generated for display by theimage display driver 842 on the see-through image displays 180C-D of theoptical assembly 180A-B. While memory 834 is shown as integrated withhigh-speed circuitry 830, in other examples, memory 834 may be anindependent standalone element of the eyewear device 100. In certainsuch examples, electrical routing lines may provide a connection througha chip that includes the high-speed processor 832 from the imageprocessor 812 or low-power processor 822 to the memory 834. In otherexamples, the high-speed processor 832 may manage addressing of memory834 such that the low-power processor 822 will boot the high-speedprocessor 832 any time that a read or write operation involving memory834 is needed.

Server system 898 may be one or more computing devices as part of aservice or network computing system, for example, that include aprocessor, a memory, and network communication interface to communicateover the network 895 with the mobile device 890 and eyewear device100/200. Eyewear device 100 and 200 is connected with a host computer.For example, the eyewear device 100 is paired with the mobile device 890via the high-speed wireless connection 837 or connected to the serversystem 898 via the network 895.

Output components of the eyewear device 100 include visual components,such as the left and right image displays 180C-D of optical assembly180A-B as described in FIGS. 2C-D (e.g., a display such as a liquidcrystal display (LCD), a plasma display panel (PDP), a light emittingdiode (LED) display, a projector, or a waveguide). The image displays180C-D of the optical assembly 180A-B are driven by the image displaydriver 842. The output components of the eyewear device 100 furtherinclude acoustic components (e.g., speakers), haptic components (e.g., avibratory motor), other signal generators, and so forth. The inputcomponents of the eyewear device 100 and 200, the mobile device 890, andserver system 898, may include alphanumeric input components (e.g., akeyboard, a touch screen configured to receive alphanumeric input, aphoto-optical keyboard, or other alphanumeric input components),point-based input components (e.g., a mouse, a touchpad, a trackball, ajoystick, a motion sensor, or other pointing instruments), tactile inputcomponents (e.g., a physical button, a touch screen that provideslocation and force of touches or touch gestures, or other tactile inputcomponents), audio input components (e.g., a microphone), and the like.

Eyewear device 100 may optionally include additional peripheral deviceelements 919. Such peripheral device elements may include ambient lightand spectral sensors, biometric sensors, additional sensors, or displayelements integrated with eyewear device 100. For example, peripheraldevice elements 819 may include any I/O components including outputcomponents, motion components, position components, or any other suchelements described herein. The eyewear device 100 can take other formsand may incorporate other types of frameworks, for example, a headgear,a headset, or a helmet.

For example, the biometric components of the user interface field ofview adjustment 900 include components to detect expressions (e.g., handexpressions, facial expressions, vocal expressions, body gestures, oreye tracking), measure biosignals (e.g., blood pressure, heart rate,body temperature, perspiration, or brain waves), identify a person(e.g., voice identification, retinal identification, facialidentification, fingerprint identification, or electroencephalogrambased identification), and the like. The motion components includeacceleration sensor components (e.g., accelerometer), gravitation sensorcomponents, rotation sensor components (e.g., gyroscope), and so forth.The position components include location sensor components to generatelocation coordinates (e.g., a Global Positioning System (GPS) receivercomponent), WiFi or BluetoothTM transceivers to generate positioningsystem coordinates, altitude sensor components (e.g., altimeters orbarometers that detect air pressure from which altitude may be derived),orientation sensor components (e.g., magnetometers), and the like. Suchpositioning system coordinates can also be received over wirelessconnections 925 and 837 from the mobile device 890 via the low-powerwireless circuitry 924 or high-speed wireless circuitry 836.

Referring to FIG. 9 , there is shown a functional block diagram at 900that forms a part of diagram 800, including a high-speed bus 902 and alow-speed bus 904 each configured to communicate data between thehigh-speed processor 832, such as a system on a chip (SOC), and thehigh-speed wireless transceiver 836. The high-speed transceiver 836supports multiple interfaces for data and control communication.

The wireless system power consumption can be high in a connected standbymode with the processor 832 operating as an active host interface.Turning off the host interface during non-use can increase communicationdelays which might be unacceptable for a low latency application. Forexample, an active universal serial bus (USB) interface of the processor832 adds around 15-20 mA to the system power consumption. In an exampleeyewear 100, with 100-200 mAh total battery capacity, a total standbymode current consumption is desired to be very low, such as less than1-2 mA.

In an example, the host processor 832 has both a high-speed USB host anda low-speed universal asynchronous receiver-transmitter (UART) host thatcan communicate with the high-speed transceiver 836 simultaneously. Highspeeds interfaces like the USB consume higher standby current than lowspeed interfaces like UART. For example, the standby current for the USBmay be 20 mA, and the standby current for the UART may be under 1 mA.Lower standby current and low latency communication are very importantfor an eyewear formfactor having a smaller battery.

The high-speed interface standby current consumption can be reduced bydisabling/suspending the USB host, but that is not possible when thereare multiple devices connected to that interface. Further, thehigh-speed USB interface has high latency to enable a link and restartcommunication.

In accordance with one example, this disclosure provides adaptiveswitching by the processor 832 between the high-speed USB interface andlow-speed UART interface. A high-speed USB hub 838 and switch 51 is usedby the processor 832 to enable and disable the high-speed USB interfaceto the high-speed wireless transceiver 836. The processor 832 sends acontrol signal from a USB control port to the switch S1 to selectivelyenable and disable the high-speed USB interface to the high-speedwireless transceiver 836. The processor 832 is configured to communicatewith other high-speed peripherals without using the switch S1. Thehigh-speed USB interface is used for high-speed communication, and thelow-speed UART interface is used in a standby mode when there is no USBhost-initiated communication or downlink traffic. This configurationavoids about 15-20 mA in standby current by selectively disabling thehigh-speed USB interface. The processor 832 will continue using the UARTlow-speed interface for any small data packet transfer, paging, lowspeed communication link. The processor 832 turns on and uses thehigh-speed USB interface when, for example, the host starts anapplication which requires the high-speed link, or when the processor832 needs to receive a large amount of data through downlink from thenetwork or other eyewear. Keeping the UART low-speed interface onensures low latency but also saves significant standby currentconsumption.

Referring now to FIG. 10 , there is shown a method 1000 of operating theprocessor 832.

Initially, at block 1002 the host processor 832 enables both USBhigh-speed interface and UART low-speed interface for communication.

At block 1004, once data transfer is complete between the host processor832 and another device using the USB high-speed interface, the hostprocessor 832 keeps both interfaces active for a predetermined period oftime using a timer.

At block 1006, when the timer expires due to no activity, the processor832 turns off, disables, or suspends the USB high-speed interface andmaintains wireless connectivity using the UART low-speed interface.

At block 1008, when the host processor 832 needs to uplink data, e.g.,depending on an application initiating a transfer/data size exceeding apredetermined limit, the host processor 832 uses the UART low-speedinterface at block 1010 and 1012, or enables the USB high-speedinterface and starts data transfer at block 1014 and 1016.

When the wireless subsystem receives downlink packets at block 1018, thedata is initially sent to host processor 832 using the UART low speedinterface, and low latency communication maintained at block 1020.

At block 1022, depending on, for example, the type of received datapacket, packet size, destination application/program/subsystem, or acombination thereof, the USB high-speed interface is turned on for largedownlink data.

To further save current consumption, the host processor 832 can disablethe UART low-speed interface whenever the USB high-speed interface isactive, and then turn on the low-speed UART interface before disablingthe USB high-speed interface. Where the UART low-speed interface drawslittle current, there might not be much current saving by disabling it.In some cases, the UART low-speed interface may always be on and cannotbe disabled.

According to some examples, an “application” or “applications” areprogram(s) that execute functions defined in the programs. Variousprogramming languages can be employed to create one or more of theapplications, structured in a variety of manners, such asobject-oriented programming languages (e.g., Objective-C, Java, or C++)or procedural programming languages (e.g., C or assembly language). In aspecific example, a third-party application (e.g., an applicationdeveloped using the ANDROID™ or IOS™ software development kit (SDK) byan entity other than the vendor of the particular platform) may bemobile software running on a mobile operating system such as IOS™,ANDROID™ WINDOWS® Phone, or another mobile operating system. In thisexample, the third-party application can invoke API calls provided bythe operating system to facilitate functionality described herein.

It will be understood that the terms and expressions used herein havethe ordinary meaning as is accorded to such terms and expressions withrespect to their corresponding respective areas of inquiry and studyexcept where specific meanings have otherwise been set forth herein.Relational terms such as first and second and the like may be usedsolely to distinguish one entity or action from another withoutnecessarily requiring or implying any actual such relationship or orderbetween such entities or actions. The terms “comprises,” “comprising,”“includes,” “including,” or any other variation thereof, are intended tocover a non-exclusive inclusion, such that a process, method, article,or apparatus that comprises or includes a list of elements or steps doesnot include only those elements or steps but may include other elementsor steps not expressly listed or inherent to such process, method,article, or apparatus. An element preceded by “a” or “an” does not,without further constraints, preclude the existence of additionalidentical elements in the process, method, article, or apparatus thatcomprises the element.

Unless otherwise stated, any and all measurements, values, ratings,positions, magnitudes, sizes, and other specifications that are setforth in this specification, including in the claims that follow, areapproximate, not exact. Such amounts are intended to have a reasonablerange that is consistent with the functions to which they relate andwith what is customary in the art to which they pertain. For example,unless expressly stated otherwise, a parameter value or the like mayvary by as much as ±10% from the stated amount.

In addition, in the foregoing Detailed Description, it can be seen thatvarious features are grouped together in various examples for thepurpose of streamlining the disclosure. This method of disclosure is notto be interpreted as reflecting an intention that the claimed examplesrequire more features than are expressly recited in each claim. Rather,as the following claims reflect, the subject matter to be protected liesin less than all features of any single disclosed example. Thus, thefollowing claims are hereby incorporated into the Detailed Description,with each claim standing on its own as a separately claimed subjectmatter.

While the foregoing has described what are considered to be the bestmode and other examples, it is understood that various modifications maybe made therein and that the subject matter disclosed herein may beimplemented in various forms and examples, and that they may be appliedin numerous applications, only some of which have been described herein.It is intended by the following claims to claim any and allmodifications and variations that fall within the true scope of thepresent concepts.

What is claimed is:
 1. Eyewear, comprising: a frame; an optical member;a display coupled to the optical member; a wireless transceiver; and aprocessor having a high-speed interface coupled to the wirelesstransceiver, and low-speed interface coupled to the wirelesstransceiver, wherein the processor is configured to use the high-speedinterface for high-speed communications and to use the low-speedinterface for low-speed communications, wherein the high-speed interfaceis turned off when not communicating and consumes no standby power,while the low-speed interface remains on.
 2. The eyewear of claim 1,wherein the eyewear further includes a controller configured toselectively control when the high-speed interface is enabled.
 3. Theeyewear of claim 1, wherein the low-speed interface is a universalasynchronous receiver-transmitter (UART) interface.
 4. The eyewear ofclaim 3, wherein the high-speed interface is a universal serial bus(USB) interface.
 5. The eyewear of claims 4, wherein the eyewear furtherincludes a USB hub configured to selectively control when the high-speedinterface is enabled.
 6. The eyewear of claim 4, wherein the UARTinterface is always on to provide low latency communication without anypower penalty.
 7. The eyewear of claim 1, wherein when the wirelessreceiver initially receives data, only the low-speed interface isconfigured to be used by the processor for receiving the initial data.8. The eyewear of claim 7, wherein the processor is configured todetermine if the initial data is associated with high-speed data, andthe processor is configured to responsively use the high-speed interfaceonly if the initial data is determined to be associated with high-speeddata.
 9. A method of use of eyewear comprising a frame, an opticalmember, a display coupled to the optical member, a wireless transceiver,and a processor having a high-speed interface coupled to the wirelesstransceiver, and low-speed interface coupled to the wirelesstransceiver, comprising: sending, by the processor, high-speedcommunications using the high-speed interface; sending, by theprocessor, low-speed communications using the low-speed interface;disabling, by the processor, the high-speed interface and using only thelow-speed interface such that there is no standby current used by thehigh-speed interface; and enabling, by the processor, the high-speedinterface when the processor determines it needs to send or receivehigh-speed communications.
 10. The method of claim 9, wherein theeyewear further includes a controller selectively controlling when thehigh-speed interface is enabled.
 11. The method of claim 9, wherein thelow-speed interface is a universal asynchronous receiver-transmitter(UART) interface.
 12. The method of claim 11, wherein the high-speedinterface is a universal serial bus (USB) interface.
 13. The method ofclaims 12, wherein the eyewear further includes a USB hub selectivelycontrolling when the high-speed interface is enabled.
 14. The method ofclaim 12, wherein the UART interface is always on to provide low latencycommunication without any power penalty.
 15. The method of claim 9,wherein when the wireless receiver initially receives data, only thelow-speed interface is used by the processor for receiving the initialdata.
 16. The method of claim 15, wherein the processor determines ifthe initial data is associated with high-speed data, and the processorresponsively uses the high-speed interface only if the initial data isdetermined to be associated with high-speed data.
 17. A non-transitorycomputer-readable medium storing program code which, when executed, isoperative to cause an electronic processor of an eyewear device having aframe, an optical member, a display coupled to the optical member, awireless transceiver, a processor having a high-speed interface coupledto the wireless transceiver, and low-speed interface coupled to thewireless transceiver, to perform the steps of: sending high-speedcommunications using the high-speed interface; sending low-speedcommunications using the low-speed interface; disabling the high-speedinterface and using only the low-speed interface such that there is nostandby current used by the high-speed interface; and enabling thehigh-speed interface when the processor determines it needs to send orreceive high-speed communications.
 18. The non-transitorycomputer-readable medium of claim 17, wherein the code is operative suchthat the controller selectively controls when the high-speed interfaceis enabled.
 19. The non-transitory computer-readable medium of claim 17,wherein the code is operative such that when the wireless receiverinitially receives data, only the low-speed interface is used forreceiving the initial data.
 20. The non-transitory computer-readablemedium of claim 19, wherein the code is operative such that theprocessor determines when the initial data is associated with high-speeddata, and the processor responsively uses the high-speed interface onlyif the initial data is determined to be associated with high-speed data.